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Abstract 

Efficiency  dictates  that  plans  for  large-scale  distributed  activities  be  revised  incrementally, 
with  parts  of  plans  being  revised  only  if  the  expected  utility  of  identifying  and  revising  the  sub¬ 
plans  improve  on  the  expected  utility  of  using  the  original  plan.  The  problems  of  identifying  and 
reconsidering  the  subplans  affected  by  changed  circumstances  or  goals  are  closely  related  to  the 
problems  of  revising  beliefs  as  new  or  changed  information  is  gained.  But  traditional  techniques 
of  reason  maintenance — the  standard  method  for  belief  revision — choo.se  revisions  arbitrarily 
and  enforce  global  notions  of  consistency  and  grouiidedness  which  may  mean  reconsidering  all 
beliefs  or  plan  elements  at  each  step.  We  develop  revision  methods  aiming  to  revise  only  those 
beliefs  and  plans  worth  revising,  and  to  tolerate  incoherence  and  ungroundedne.ss  when  these 
are  judged  less  detrimental  than  a  costly  revision  effort.  We  use  an  artificial  market  economy  in 
planning  and  revision  tasks  to  arrive  at  overall  judgments  of  worth,  and  present  a  representation 
for  qualitative  preferences  that  ])ermits  capture  of  common  forms  of  dominance  information. 
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1  Planning  and  replanning 

Planning  is  necessary  for  the  organization  of  large-scale  activities  because  decisions  about  actions 
to  be  taken  in  the  future  have  direct  impact  on  what  should  be  done  in  the  shorter  term.  But  even 
if  well-constructed,  the  value  of  a  plan  decays  as  changing  circumstances,  resources,  information,  or 
objectives  render  the  original  course  of  action  inappropriate.  When  changes  occur  before  or  during 
execution  of  the  plan,  it  may  be  neces.sary  to  construct  a  new  plan  by  starting  from  scratch  or  by 
revising  a  previous  plan.  In  fact,  replanning  may  be  worthwhile  even  when  the  new  situation  does 
not  deviate  significantly  from  prior  expectations.  The  original  plan  may  have  been  constructed 
to  perform  acceptably  over  a  wide  range  of  po.ssible  circumstances,  and  knowing  more  about  the 
particular  situation  encountered  may  enable  construction  of  strategies  which  are  better  suited  to 
the  case  at  hand.  Thus  rather  than  viewing  activities  as  the  result  of  a  sequential  process  in 
which  one  first  plans  aiid  then  executes,  we  vkuv  the  process  more  as  dc'picted  in  Figure  1,  which 
indicates  planning  and  replanning  interleaved  with  each  other  and  with  ongoing  execution  and 
observation  actions.  In  this  model  of  the  plan  construction  process,  the  planner  and  replanner 


Figure  1:  An  integrated  planning,  replanning,  and  execution  system. 

continually  evaluate  and  revise  the  existing  plan  in  light  of  what  ha|)pen.s  in  the  world.  The 
distinction  between  planning  and  replanning  is  that  the  latter  uses  the  existing  plan  to  focus 
attention  on  a  restricted  .set  of  decisions  about  actions  to  be  performed.  The  tight  coupling  of 
the  planning  and  replanning  modules  is  indicative  of  the  strong  interactions  between  their  designs. 
Knowledge  about  the  capability  of  the  replanner  dictates  where  planning  effort  should  be  spent 
anticipating  particular  contingencies,  and  the  replaimer  reciuires  reciprocal  access  to  the  planner  s 
reasons  for  adopting  the  current  strategy  in  order  to  intelligently  adapt  it  for  changing  situations. 

There  are  two  central  decisions  surrounding  the  replanning  process.  First,  given  the  information 
accrued  during  plan  execution,  which  remaining  parts  of  the  original  plan  should  be  salvaged  and 
in  what  ways  should  other  parts  be  changed?  Incremental  modification  is  more  efficient  than 
wholesale  replanning,  but  a  restriction  to  local  changes  can  compromi.se  the  value  of  the  revised 
plan.  Second,  to  what  extent  should  the  planner  attempt  to  avoid  the  need  for  replanning  by 
anticipating  contingencies  and  providing  for  them  in  the  original  plan.^  Contingency  planning 
improves  the  capacity  for  re.sponse  when  replanning  time  is  limited,  but  the  return  on  investment 
rapidly  diminkshes  as  the  likelihood  of  particular  contingencies  decreases. 

To  replan  effectively  in  crisis  situations,  replaiming  must  be  increvic.ntal,  so  that  it  modifies 
only  the  portions  of  the  plan  actually  affected  by  the  changes.  Incremental  replanning  first  involves 
localizing  the  potential  changes  or  conflicts  by  identifying  the  sub.set  of  the  extant  beliefs  and  plans 
in  which  they  occur.  It  then  involves  choosing  which  of  the  identified  beliefs  and  plans  to  keep  and 
which  to  change.  For  greatest  efficiency,  the  choices  of  what  portion  of  the  plan  to  revise  and  how  to 
revise  it  .should  be  based  on  coherent  expectations  about  and  preferences  among  the  consequences 
of  different  alternatives  so  as  to  be  rational  in  the  .sense  of  decision  theory. 


2  Rational  planning  and  replanning 

According  to  decision  theory,  a  clioice  is  rational  if  it  is  of  maximal  expected  utility  among  all 
alternatives.  But  planning  and  replanning  involve  at  least  two  different  .sorts  of  decisions,  and 
applying  the  standard  of  rationality  to  each  yields  different  notions.  The  fundamental  distinction  is 
that  l)etween  restdl  rationality  and  process  rationality.  Rationality  of  result  measures  how  efficiently 
the  plan  achieves  specified  objectives.  Complementing  this,  rationality  of  process  measures  how 
efficiently  the  planner  expends  its  efforts  in  constructing  the  plan,  that  is,  the  efficiency  of  the 
operation  of  the  combined  planning/replanning  system.  While  most  investigations  of  planning 
have  focused  on  one  or  the  other,  both  elements  are  e.ssential  to  the  overall  rationality  of  the 
planning  system. 

Making  any  process  rational  is  not  easy,  for  straightforward  mechanizations  of  decision-theoretic 
definitions  can  require  more  information  than  is  available  and  more  computation  than  is  feasible 
to  use  that  information.  Sophisticated  mechanizations  are  more  tractable,  but  the  main  tool  for 
achieving  rationality  in  reasoning  is  to  distinguish  between  explicit  aiid  implicit  rationality  in 
processes.  Computational  mechanisms  may  calculate  and  compare  expected  utilities  in  order  to 
make  explicitly  rational  choices.  Explicit  rational  choice  promises  to  be  most  useful  in  guiding 
some  of  the  larger  meta-level  decisions  about  whether  to  replan  globally  or  incrementally,  and  in 
choosing  which  contingencies  call  for  planned  responses.  For  the  more  numerous  small  decisions 
that  arise,  however,  explicitly  representing  and  calculating  expected  utilities  may  not  be  worth  the 
cost.  Instead,  the  more  useful  approach  is  to  apply  non-decision-theoretic  reasoning  mechanisms 
whose  results  may  be  justified  as  rational  by  separate  decision-theoretic  analy.ses.  Such  mechanisms 
may  be  viewed  as  “compiling’’  the  results  of  explicit  rational  analysis  into  directly  applicable  forms. 
Each  of  these  ways  of  imidementing  rationality  is  best  in  sotne  circumstances,  since  compilation  is 
not  always  possible  or  worthwhile. 

Examples  of  implicitly  rational  procedures  abound  in  AT  under  the  name  of  heuristics.  For 
instance,  the  “.status  quo  optimality”  heuristic  [29,  Section  G.4.1]  constrains  the  set  of  possible 
revisions  under  the  assumption  that  the  current  plan  is  o[)timal.  In  particular,  the  replanner  need 
only  respond  to  the  specific  changes.  A  relatc^d  (‘xam[)l(^  is  application  of  the  basic  theorem  of 
optimization  that  says  that  if  the  only  change  is  a  tightening  of  constraints,  the  currently  optimal 
plan  remains  optimal  if  it  remains  feasible.  Another  example,  of  somewhat  different  character, 
is  provided  by  the  assumptions  made  by  nonmonotonic  default  rules.  These  rules  for  coming 
to  assumptions  are  important  forms  of  heuristics.  Though  algorithms  for  determining  sets  of 
conclusions  from  default  rules  do  not  involve  any  explicit  rationality  calculations,  the  conclusions 
drawn  can  be  shown  to  be  Pareto  optimal  sets,  that  is,  rational  choices  of  conclusions  when  the 
default  rules  are  interpreted  as  preferences  over  staters  of  bolieff  [8,  11].  Viewed  this  way,  defiiult 
rules  encode  compiled  preferences,  and  mechanisms  for  deriving  sets  of  conclusions  from  default 
rules  constitute  an  example  of  an  implicitly  rational  choice  mechanism. 

Process  rationality  enters  the  task  of  planning  in  numerous  ways.  For  example,  in  the  develop¬ 
ment  of  a  plan,  contingency  plans  .should  be  inchuhid  only  when  the  expected  utility  of  preparing 
them  is  sufficiently  great:  if  the  contingency  is  likely  to  occur  and  if  the  costs  of  developing  it 
in  advance  are  less  than  the  costs  of  constructing  it  under  the  tighter  constraints  existing  while 
executing  the  enclosing  f)lan.  Similarly,  a  portion  of  a  large  plan  should  be  revised  only  if,  given  the 
new  information,  the  expected  costs  and  benc’fits  of  idciutifying  which  plan  elements  need  revising 
outweigh  those  expected  for  either  using  the  original  portion  or  replaiining  from  scratch. 

Making  the.se  judgments  requires  information  about  the  likelihoods,  costs,  and  benefits  of  dif¬ 
ferent  .sorts  of  contingencies  and  plaiming  respon.ses.  This  includes  the  likelihood  of  specific  con¬ 
tingencies  arising,  their  importance  if  they  do  ari.se,  and  the  costs  of  planning  for  them;  similarly. 
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the  likelihood  of  one  part  of  the  plan  being  affected  by  changes  in  another,  the  importance  of  those 
changes,  and  the  costs  of  determining  and  effecting  tliem. 

While  many  of  the  likelihoods  involved  in  planning  derive  from  the  specifications  of  the  task, 
the  costs  and  benefits  of  reasoning  steps  involved  in  planning  are  functions  of  the  underlying 
representational  and  reasoning  architecture.  The  theory  of  computation  supplies  some  abstract 
notions  of  computational  costs,  such  as  >vorst-case  time  and  space  taken  by  Turing  machines. 
However,  significant  differences  in  reasoning  time  and  space  can  be  lost  in  the  translation  to  Turing 
machines,  and  the  worst  case  is  not  the  only  one  of  interest.  Use  of  the  theory  of  rational  decisions 
effectively  in  making  judgments  about  plan  revision  requires  realistic  measures  of  computational 
costs  and  benefits  appropriate  to  the  particular  architecture  of  the  planner,  as  well  as  expectations 
appropriate  to  the  domain  of  planning.  Our  development  of  the  planning  architecture  attempts  to 
make  formalization  and  estimation  of  these  measures  more  direct. 

Most  treatments  of  decision  theory  focus  on  single  decisions.  Tho.se  that  treat  decisions  over 
time  usually  assume  that  the  preferences  of  the  decision-maker  remain  constant  (or  change  little) 
over  the  interval  in  question.  But  such  assumptions  are  inappropriate  to  many  situations  of  re¬ 
planning  within  large-.scale  activities.  Due  to  the  scope  of  the  activities,  it  is  unrealistic  to  expect 
human  planners  and  authorities  guiding  the  activities  to  be  able  to  articulate  all  their  preferences 
in  advance.  In  addition,  wars  and  other  extended  activities  significantly  increase  the  likelihood  that 
some  of  the  authorities  in  cpiestion  will  be  replaced,  either  tlirough  deatli,  discharge,  coups  or  elec¬ 
tions.  In  such  .settings,  a  replanning  system  must  be  prepared  to  accept  changes  to  its  preferences 
as  well  as  changes  in  more  “objective”  information.  Accordingly,  we  seek  to  make  replanning  truly 
flexible,  accommodating  changes  in  any  element  of  information,  including  the  problem  specification, 
background  knowledge,  and  preferences. 

3  Reason  maintenance  for  incremental  replanning 

Replanning  in  an  incremental  and  local  manner  reciuires  that  the  planning  procedures  routinely 
identify  the  assumptions  made  during  planning  and  connect  plan  elements  with  the.se  assumptions, 
so  that  replanning  may  .seek  to  change  only  those  portions  of  a  plan  dependent  upon  assumptions 
brought  into  question  by  new  information.  Conseciuently,  the  problem  of  revising  plans  to  account 
for  changed  conditions  has  much  in  common  with  the  problem  of  revising  l)eliefs  in  light  of  new 
information.  In  both  cases,  one  must  determine  which  existing  beliefs  or  plans  conflict  with  tlie 
new  information,  on  what  these  existing  beliefs  or  plans  depend,  and  what  gaps  in  plans  or  i)eliefs 
appear  as  the  revisions  or  updates  are  made.  That  is,  one  must  localize  the  potential  changes  or 
conflicts  by  identifying  the  subset  of  the  extant  beliefs  and  plans  in  which  they  occur.  Similarly, 
both  belief  revision  and  plan  revision  involve  choosing  wliich  of  the  identified  beliefs  and  plans  to 
keep  and  which  to  change.  In  addition,  the  prol>lem  of  providing  for  contingencies  has  much  in 
common  with  the  problem  of  choosing  rules  for  reasoning  by  default,  for  both  involve  setting  u[) 
primary  plans  or  beliefs  and  the  secondary  plans  or  beliefs  to  u.se  when  the  primary  ones  are  not 
applicable. 

The  standard  approach  to  l)elief  revision,  backtracking,  and  d(Tault  reasoning  is  to  ase  a  reason 
maintenance  .system  (RMS)  to  connect  original  information  witli  derived  conclusions  and  a.ssump- 
tions.  Reason  maintenance  may  be  used  in  a  similar  way  to  revise  plans  as  well  as  beliefs  l)y 
indicating  the  dependence  of  plaiis  on  beliefs  and  on  otl)er  plans,  thus  indicating  the  relevant  por¬ 
tions  for  revision  and  the  conflicts  between  prior  plans  and  new  circumstances.  This  po.ssibility 
was,  in  fact,  one  of  tlie  original  motivations  for  reason  maintenance  systems  (.see  [4,  5]).  However, 
to  employ  reason  maintenance  techniciues  as  integral  parts  of  the  rejdanning  proce.s.s  requires  re- 


assessing  and  rethinking  most  of  the  architectures  for  reason  maintenance  developed  previously,  for 
these  architectures  do  not  make  rational  choices,  they  do  not  distribute  effort,  and  they  do  not  fit 
cleanly  into  existing  methods  and  architectures  for  planning. 

3.1  The  traditional  conception  of  reason  maintenance 

In  the  traditional  conception,  a  reason  maintenance  system  acts  as  a  subsystem  of  a  more  gen¬ 
eral  system  for  reasoning.  It  revises  the  database  states  of  the  overall  system  by  using  records 
of  inferences  or  computations  to  trace  the  conseciuences  of  initial  changes.  By  keeping  track  of 
what  information  has  been  computed  from  what,  such  it  reconstructs  the  information  “derivable” 
from  given  information.  Although  we  find  it  convenient  to  think  of  these  bits  of  information  and 
derivations  as  beliefs  and  arguments,  one  may  apply  reason  maintenance  more  generally  to  all  sorts 
of  computational  or  mental  structures,  including  intentions,  preferences,  and  other  plan  elements. 

For  concreteness,  we  describe  the  structure  of  the  particular  reason  maintenance  system  RMS 
developed  by  the  author  [5].  We  may  formalize  its  e.s.sential  features  as  follows,  simplifying  its 
complex  actual  structure  in  ways  that  do  not  matter  for  the  present  discussion.  (See  [6,  7,  11]  for 
more  detailed  discussions.)  States  of  RMS  contain  two  typos  of  elements:  nodes  and  reasoris.  We 
write  Af  to  denote  the  set  of  possible  nodes,  and  Tv  to  denote  the  set  of  possible  reasons.  RMS 
uses  nodes  to  represent  information  (beliefs,  desires,  rules,  procedures,  database  elements,  etc.)  of 
significance  to  the  overall  reasoning  system,  but  those  “externar  meanings  have  no  bearing  on  the 
“internar  operation  of  RMS.  RMS  uses  reasons  to  represent  inferences,  or  more  precisely,  specific 
inference  rules.  Because  nodes  need  not  represent  l)eliefs,  RMS  imposes  no  logic  on  nodes.  Instead, 
the  only  relations  among  nodes  are  those  indicated  explicitly  by  reasons.  These  may,  if  desired, 
encode  logical  relations  directly.  In  the  simplest  setting,  no  nodes  are  reasons,  so  that  each  state 
consists  of  a  set  N  C  Af  of  nodes  and  a  set  /?  C  Tv  of  reasons.^  We  say  that  each  node  in  N  is  in 
(the  set  of  beliefs),  and  that  each  node  \n  Af\  N  is  out  (of  the  set  of  beliefs). 

The  original  RMS  provided  two  types  of  reasons:  stipport4ist  reasons  and  conditional-proof 
reasons.  For  simplicity,  we  will  ignore  conditional-proof  reasons  and  assume  that  all  reasons  are 
support-list  reasons.  Each  support-list  reason  takers  th(^  form  (/, 0,c)  where  1^0  QAf  and  c  G  Af > 
The  components  /,  O  and  c  are  called  the  inlist^  lh(‘  outlist^  and  the  coiisequent^  respectively.  W(^ 
call  the  reason  mono  tonic  if  O  is  empty,  and  Jionmonotonic  otherwise.  Each  reason  is  interpreted 
as  a  rule  stipulating  inferences  the  RMS  must  make,  according  to  which  the  conseciuent  holds  if  all 
of  tlie  nodes  in  the  inlist  are  held  and  none  of  the  nodes  in  the  outlist  are  held.  Adding  a  reason  of 
the  form  ({},{},  c)  makes  c  a  premise  or  basic  belief;  adding  a  monotonic  rea.son  with  a  nonempty 
inlist  corresponds  to  adding  an  ordinary  argument  step,  and  adding  a  nonmonotonic  reason  lets 
RMS  adopt  a  belief  as  an  assumption. 

A  state  (W,  R)  is  a  legal  state  of  RMS  just  in  case*  N  consists  exactly  of  the  groiinded  conse- 
cpiences  of  the  reasons  /?,  that  is,  N  satisfies  every  reason  in  R  and  if  every  node  in  N  is  sui)ported 
l)y  a  noncircular  argument  from  the  valid  reasons  in  R.  Formally,  (AT,  R)  is  a  legal  state  just  in 
case 

1.  If  (/,0,c)  G  /?,  /  C  /V,  and  iV  fi  O  =  0,  then  c  G  N]  and 

2.  If  n  G  N,  then  there  is  a  finite  .secpience  (710,  •  •  •  of  elements  of  N  U  R  such  that  n  =  iim 
and  for  each  i  <  rn,  either  Ui  G  /?,  or  there  is  some  j  <  i  such  that 

Mt  is  easy  to  construct  theories  in  wliich  reasons  are  luxles  themselves,  and  so  may  support  otlier  reasons.  In 
such  theories,  one  may  express  all  reasons  as  defeasihle  reasons  aiul  express  all  changes  of  belief  through  addition  of 
reasons.  See  [7]  for  details. 
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(a)  7ij  =  {I,0,7ii), 

(b)  for  each  x  €  /,  x  =  7ik  for  some  k  <  j,  and 

(c)  X  ^  N  for  each  x  €  O. 

Each  set  of  reasons  supports  0  or  more  legal  states.  For  example,  {({.t},  {.cI.-t)}  supports  none, 
{({}>  {}»»)}  supports  one,  and  {({},  {.c},  j/),  ({},  {?/},«)}  supports  two  if  x  7^  y. 

Wlienever  the  reasoner  adds  or  deletes  re<a.sons,  RMS  updates  the  set  of  nodes  to  produce  a 
new  legal  state.  Because  a  single  set  of  reasons  may  support  any  of  several  .sets  of  nodes,  these 
updates  Involve  choices.  The  original  RMS  update  algorithm  was  designed  to  attempt  to  update 
states  conservatively.  That  is,  if  one  takes  the  current  state  (TV,  /?,)  and  modifies  R  to  obtain  R', 
RMS  should  choose  a  new  legal  state  (N\  R!)  with  a  set  of  nodes  N'  as  close  as  possible  to  the 
current  set  N.  More  precisely,  RMS  should  choose  N'  .so  that  for  any  other  legal  state  (N",  /?,'), 
neither  TV  A  Af"  C  iV  A  iV'  nor  TV  A  AT'  C  Af  A  /V"  holds,  where  A  denotes  symmetric  differeiKe 
(X  A  F  =  (X  \  F)  U  (F  \  X)).  Due  to  the  difficulty  of  quickly  computing  this  form  of  con.servative 
updates,  however,  RMS  only  approximated  conservative  updates.  Reason  maintenance  systems 
developed  later  use  simpler  notions  of  conservatism  which  may  be  computed  more  ra|)idly  (.see,  for 
example,  [19,  2.3]. 

The  RMS  also  supports  the  operation  of  the  (Iepe7ule7ic7j-(lirected  backlrackmg  (DDB)  system, 
which  attempts  to  defeat  assumptions  underlying  those  nodes  identified  as  co7itradiclio7is.  Now 
consistency  does  not  matter  to  RMS  in  adding  or  deleting  reasons;  instead,  the  basic  operations  of 
RMS  only  maintain  coherence  of  reasons  and  nodes.  (Many  discussions  of  reason  maintenance  mi.s- 
represent  the  truth  by  claiming  that  RMS  maintains  consistency  of  beliefs.  This  mi.srepre.sentation 
may  stem  from  the  .somewhat  misleading  role  of  logical  consistency  in  nonmonotonic  logic  [20].) 
Since  RMS  has  no  knowledge  of  the  meanings  of  nodes,  the  reasoner  must  tell  it  which  nodes  repre¬ 
sent  contradictions.  RMS,  in  turn,  informs  DDB  whenever  a  contradiction  node  becomes  believed, 
at  which  point  the  backtracker  attempts  to  defeat  the  arguments  supporting  the  contradiction  node 
by  defeating  as.sumptions  underlying  those  arguments.  DDB  never  attempts  to  remove  reasons  or 
premises,  only  to  defeat  nonmonotonic  assumptions.  If  the  argument  for  the  contradiction  node 
does  not  depend  on  any  of  these  (i.e.,  it  consists  entirely  of  monotonic  reasons),  DDB  leaves  the 
contradiction  node  in  place  as  a  continuing  belief. 

.Just  as  RMS  seeks  to  minimize  changes  through  its  incremental  update  algorithm,  DDB  seeks 
to  effect  minimal  revisions  in  choosing  which  assumption  to  defeat.  Specifically,  the  backtracker 
defeats  only  “maximal”  assumptions  that  do  not  depend  on  other  assumptions.  This  means,  in 
effect,  that  DDB  topologically  .sorts  the  beliefs  supporting  the  contradiction  node  by  viewing  the 
reasons  comprising  the  supporting  argument  as  a  directed  hypergraph.  The  maximally-positioned 
assumptions  in  this  ordering  of  beliefs  then  constitute  the  candidates  for  defeat.  The  backtracker 
then  choo.ses  one  of  the.se  assumptions  and  defeats  the  reason  supporting  the  cho.sen  assumption 
by  providing  a  new  reason  for  one  of  the  nodes  in  its  outlist.  The  new  defeating  reason  is  entirely 
monotonic,  and  expresses  the  inconsistency  of  the  cho.sen  assumption  with  the  other  maximal 
assumptions  and  with  other  maximally-ordered  beliefs  in  the  contradiction  node’s  support.  The 
actual  procedure  is  fairly  complex,  and  we  do  not  attempt  to  formalize  it  here. 

3.2  Rational  reason  maintenance 

E.s.sentially  all  the  choices  made  by  tnulitional  RMSs  are  irrational  since  they  are  made  without 
reference  to  any  preferential  information  al)out  what  choices  are  better  than  others.  The  most 
obvious  decisions  concern  backtracking:  whether  observed  conflicts  warrant  rc.solution  and  if  .so, 
which  assumption  (maximal  or  otherwise)  to  retract  in  order  to  re.solve  them.  Approaches  to  each 
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of  these  decisions  play  prominent  roles  in  the  design  of  different  reason  maintenance  systems.  But 
if  we  are  to  achieve  the  efficiency  re(|uired  for  revising  large  plans,  reason  maintenance  must  he 
redesigned  to  make  the.se  choiaw  rationally  wlnnuiver  possibk*.  Accordingly,  we  developed  formal 
foundations  for  the  theory  of  rational  belief  revision  [9,  10].  But  to  really  achieve  efficiency,  the 
RMS  must  do  more  than  choose  rationally  among  assumptions  in  backtracking.  It  must  in  addition 
be  much  more  incremental  than  the  original  architectures,  which  were  based  on  making  unbounded 
(potentially  global)  optimizing  computations  that  in  some  cases  may  reconsider  the  status  of  evciy 
item  in  the  plan  and  knowledge  base,  even  though  very  few  of  these  statuses  may  change  as  the  re¬ 
sult  of  the  revision.  Put  another  way,  the  original  .systems  maintain  global  coherence  (propositions 
are  believed  if  and  only  if  there  is  a  valid  argument  for  them)  and  global  groundedness  (all  believed 
propositions  have  a  well-founded  argument  from  premi.ses).  While  these  unbounded  computations 
are  manageable  in  relatively  small  knowledge  bases,  they  are  infeasil)le  for  use  in  .systems  manipu¬ 
lating  very  large  plans.  Instead  of  global  computation.s,  the  RMS  mu.st  control  how  much  effort  is 
spent  on  revision  and  trade  off  coherence  and  groundcdne.s.s  for  time  or  other  resources.  Specifically, 
it  must  be  able  to  decide  whether  the  benefits  of  updating  some  arguments  or  consequences  justify 
the  costs  of  updating  them. 

3.3  Distributed  reason  maintenance 

To  make  the  RMS  amenal)le  to  rational  control,  wo  divide  the  knowledge  base  into  parts,  called 
locales,  each  of  which  may  be  revi.setl  or  pre.served  separately.  Each  locale  of  this  distributed  RMS 
contains  its  own  set  of  beliefs  and  plans  (iis  well  as  other  information)  corresponding  to  different 
elements  and  purposes  of  the  overall  plan  or  to  different  dimensions  of  structure  (hierarchical  ab¬ 
straction,  overlapping  views,  spatial  separation,  temporal  separation,  flow  of  material  and  informa¬ 
tion,  etc.).  Decomposition  of  knowledge  in  this  way  is  a  familiar  element  of  many  representational 
schemes  (e.g.,  those  based  on  Minsky’s  [21]  original  frame-systems  idea).  The  use  of  locality  in 
planning  is  illustrated  mo.st  explicitly  by  the  encapsulation  mechanisms  of  Lansky’s  [18]  GEMPLAN 
system. 

Along  with  the  general  desire  for  incrementality,  there  are  several  additional  reasons  for  dis¬ 
tributing  reason  maintenance  across  different  proce.ssor.s.  In  the  first  place,  the  information  and 
effort  required  may  be  too  great  to  store  or  perform  on  a  single  machine.  In  managing  very  large 
activities,  for  example,  the  most  effective  representations  may  spread  information  across  machines 
or  storage  media  of  different  speeds  and  access  times  (e.g.,  disk  storage,  large  spatial  separations). 
Even  when  the  information  resides  on  a  single  processor,  the  most  convenient  representation  may 
be  a  modular,  distributed  organization  as  described  above.  But  more  generally,  the  information 
and  actions  involved  in  some  task  may  be  naturally  distributed.  For  example,  the  nece.ssary  infor¬ 
mation  may  come  from  geographically  separated  .sensors  or  databases.  If  communication  is  either 
unreliable  or  costly,  effective  action  may  recpiire  on-site  processing.  Similarly,  there  may  be  numer¬ 
ous  people  or  devices  carrying  out  parts  of  the  task.  For  example,  in  the  task  of  operating  a  large 
manufacturing  complex,  plans  are  executed  by  line  or  cell  managers  acting  independently  except 
as  coordinated  by  the  plan.  When  changes  occur,  at  least  some  of  the  changes  in  plan  must  be 
determined  by  the  line  or  cell  managers,  since  the  complex  manager  will  not  be  able  to  keep  track 
of  all  of  the  activities  or  to  respond  quickly  enough.  Becau.se  authority  is  delegated  and  distributed, 
reactions  to  deviations  may  be  completely  decentralized  and  uncoordinatecl. 

In  addition,  distributed  revisions  may  be  valuable  b(!caus(i  different  beliefs  and  plans  may  .serve 
different  purposes.  The.se  purposes  may  dictate  careful  mainUmance  of  some  beliefs  and  more  casual 
maintenance  of  others.  A  common  case  of  this  arises  when  reasoning  is  accomplished  by  different 
subsystems  operating  at  different  rates.  Even  if  they  share  a  common  database,  it  is  often  njitural 
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to  view  each  subsystem  as  having  distinct  inputs,  outputs,  and  local  state.  In  this  setting,  different 
rates  of  inference  or  action  in  the  subsystems  call  for  differing  treatment  of  the  information  in 
computing  updates  and  checking  support  in  the  locales  used  by  the  subsystems.  For  example, 
outputs  which  change  rapidly  compared  with  how  often  they  are  used  as  inputs  need  not  demand 
reconsideration  of  conseciuences  each  time  they  change.  Instead,  it  may  be  much  more  efficient 
to  leave  the  conseciuences  untouched  and  to  have  the  consuming  subsystem  recheck  the  support 
immediately  prior  to  use — and  then  only  if  the  risks  of  unjustified  action  are  great  enough.  In  many 
cases,  we  may  expect  that  the  success  of  the  overall  plan  will  not  be  adversely  affected  if  the  beliefs 
in  the  locale  of  one  subsystem  about  plans  involving  some  distant  subsystem  are  mistaken. 

For  example,  suppose  one  part  of  a  manufacturing  plan  calls  for  receiving  parts  from  San  Diego 
at  Los  Angeles  and  then  flying  them  to  Detroit.  If  local  difficulties  promise  to  delay  the  parts  from 
San  Diego,  the  origination  portions  of  the  plan  might  be  revised  to  reroute  similar  parts  in  San 
Francisco  to  Los  Angeles.  As  long  as  this  plan  patch  attaches  appropriate  shipping  orders  for  the 
Los  Angeles  authorities,  there  is  no  need  to  notify  them  in  advance  about  the  change  in  plans. 
Indeed,  if  the  origination  plans  change  several  times  (say  from  San  Diego  to  San  Francisco,  back  to 
San  Diego,  etc.),  notifying  Los  Angeles  in  advanc(^  just  leads  to  wasted  effort  in  revising  the  latter 
portion  of  the  plan. 

3.4  The  new  conception  of  reason  maintenance 

Making  reason  maint(Miance  rational  and  distributed  in  these  ways  has  major  implications  for 
the  relationship  of  the  RMS  to  systems  using  it.  ff"he  original  RMS  architectures  make  reason 
maintenance  the  base-level  stratum  upon  which  all  other  reasoning  procedures  are  erected.  To 
enable  belief  revision,  one  must  encode  every  bit  of  information  that  might  change  in  reasons  and 
tell  these  reasons  to  the  RMS  (cf.  [25,  28]).  This  can  present  an  excessive  burden,  as  manifest  by 
the  observation  that  the  RMSs  supplied  in  expert  system  shells  all  too  often  go  unused.  If  one  must 
apply  it  to  every  step  of  reasoning,  at  every  level  down  to  the  smallest  inference,  reason  maintenance 
becomes  a  demanding  duty  rather  than  a  flexible  service  to  use  or  ignore  as  appropriate.  To 
integrate  existing  application  tools  and  systems  that  do  not  use  reason  maintenance  into  AI  systems 
that  do,  the  RMS  must  be  able  to  use  other  databases  and  processes  to  effect  its  revisions.  In 
particular,  the  RMS  must  be  able  to  treat  external  <latabases  as  the  authorities  al)out  certain 
iKdiefs,  and  it  must  be  abk^  to  operates  evem  though  other  process(\s  may  bc^  changing  th(\s('  database's 
independently  of  the  RMS.  This  makes  the  RMS  just  one  of  a  set  of  distributed  datal)ases. 

In  such  a  setting,  the  purpose  of  the  RMS  is  to  maintain  a  description  of  the  overall  system’s 
state  of  belief  that  is  as  good  as  possible  given  the  reasoner’s  purposes  and  resources.  This  de¬ 
scription  may  be  approximate,  partial,  or  imperfect,  and  it  may  be  improved  by  performing  further 
computation  as  the  resources  supplied  to  the  RMS  increase.  As  with  the  original  architectures,  the 
RMS  still  provides  explanations,  a  way  of  answering  hypothetical  ((uestions,  and  a  way  of  main¬ 
taining  coherence,  groundedness,  and  consistency  (given  enough  resources  and  information),  but 
its  primary  purpose  is  to  enable  the  reuse  of  past  computations  in  whole  or  in  part  without  having 
to  repeat  the  possibly  lengthy  searches  that  went  into  constructing  their  results.  That  is,  we  view 
reasons  as  information  about  past  computations  or  conditions  which  may  be  used  to  reconstruct 
results  in  changed  circumstances,  either  exactly  or  in  modified  form  (as  in  derivational  analogy  [2] 
or  case-based  reasoning).  Treating  reasons  as  aids  to  recomputation  is  in  marked  contrast  with  the 
traditional  use  of  reasons  as  rigid  reciuirements  that  belief  states  must  satisfy  instead  of  as  informa¬ 
tion  which  may  be  used  or  ignored  as  suits  the  reasoner’s  purposes.  Naturally,  in  this  setting  the 
RMS  is  not  expected  to  determine  com[)letely  and  accurately  what  the  system  believes.  Instead, 
it  only  offers  a  theory  of  what  the  overall  system  l)elieves — an  “autoepistemic”  theory,  in  the  sense 


1) 


of  Moore  [22],  but  not  necessarily  a  complete  or  correct  one. 

Given  this  purpose,  the  basic  operation  of  the  RMS  is  to  record  reasons  and  other  information, 
and,  when  so  instructed,  to  revise  beliefs  in  accordance  with  the  expectations  and  preferences 
supplied  by  the  reasoner.  Put  another  way,  the  default  operation  of  the  RMS  is  to  ignore  the 
information  it  records  until  it  is  told  to  revise  beliefs,  and  then  to  revise  them  only  as  far  as  can 
be  justified  by  purposes  of  the  reasoner.  Tn  the  absence  of  more  specific  instructions,  the  default 
revision  is  trivial,  simply  adding  the  new  reasons  and  their  immediate  conclusions  to  the  belief  .set. 
Thus  without  explicit  instructions,  the  RMS  does  not  propagate  changes,  does  not  ensure  beliefs 
are  grounded,  and  does  not  automatically  backtrack  to  remove  inconsistencies.  We  do  not  reciuire 
that  all  inference  be  rationally  controlled.  Some  amount  of  automatic  inference  is  acceptable  if  it 
represents  strictly  bounded  amounts  of  proce.ssing. 

To  give  some  structure  to  RMS  operations,  we  define  revision  instructions  relative  to  the  locales 
of  the  knowledge  base.  These  instructions  may  indicate  that  changes  should  propagate  within  the 
locale  containing  the  belief,  or  to  its  neighbors,  or  globally;  or  that  all  beliefs  in  the  locale  should  be 
grounded  with  re.spect  to  the  locale,  with  re.spect  to  its  neighbors,  or  globally;  or  that  backtracking 
should  be  confined  to  the  locale,  or  .should  look  further  afield  for  assumptions  to  change. 

Rea.sons  ordinarily  supply  only  partial  information  in  that  the  reasoner  need  not  registet  all 
inferences  with  the  RMS.  In  the  extreme  case,  the  external  reasoners  may  command  the  RMS 
to  simply  believe  some  proposition,  independent  of  reason.s.  This  corresponds  to  the  revision 
operation  in  philosophical  treatments  of  belief  revision  [14].  Because  of  this  partiality,  the  RMS 
will  sometimes  be  unable  to  track  all  the  consec;uencc.s  of  all  beliefs.  Although  knowledge  is  usually 
preferable  to  ignorance,  this  incompleteness  of  the  beliefs  of  the  RMS  need  not  be  detrimental 
since  the  underlying  knowledge  and  inferences  of  the  reasoner  are  incomplete  anyway.  Moreover, 
the.se  consequences  may  not  influence  the  reasoncr’s  actions,  in  which  case  all  effort  expended  in 
recording  them  would  be  wasted.  The  only  discii)line  required  of  the  reasoner  is  that  any  inferences 
that  will  not  be  performed  by  some  other  agency  and  that  cannot  be  determined  aftei  the  fact 
during  backtracking  .should  be  described  to  the  RMS. 

Correspondingly,  reasons  may  be  incorrect  in  llu;  RMS.  That  is,  the  reasoner  may  use  a  reason 
to  describe  the  result  of  a  computation,  but  may  leave  out  .some  undc^rlying  assumptions.  The 
result  is  a  reason  that  is  valid  when  those  unstated  assumptions  hold,  Imt  which  may  he  invalid 
otherwise.  Incorrect  reasons  can  be  very  troublesome  in  the  traditional  architectures,  since  they 
would  be  enforced  as  requirements  on  the  state  of  belief,  but  they  need  not  cause  special  problems 
in  the  new  conception.  Since  the  RMS  may  obey  or  ignore  reasons  depending  on  its  instructions 
and  experience,  all  reasons  are  implicitly  defeasible.  Thus  incorrect  reasons  pose  no  problems  not 
already  present  in  explicitly  defeasible  nonmonotonic  reasons. 

Just  as  reasons  may  be  incomplete,  .so  may  be  the  theories  of  mental  states  constructed  from 
them,  since  if  reasons  are  ignored,  their  conseciuences  will  not  be  believed.  More  generally,  the 
RMS  makes  it  passible  to  vary  how  many  conclusions  are  drawn  from  reasons.  For  example,  the 
system  will  ordinarily  use  reasons  to  coinstrtict  a  single  glol)al  set  of  beliefs,  as  in  the  original 
conception.  But  for  some  specific  sets  of  reasons,  say  those  corre.sponding  to  a  circumscribed 
problem,  the  RMS  may  determine  all  consistent  sets  of  beliefs  as  in  the  ATMS  [3].  Alternatively, 
only  some  consistent  interpretations  may  be  constructed,  such  as  those  maximal  in  some  order  (as 
in  preferential  nonmonotonic  logics  [27]).  In  general,  Lh(i  aim  is  to  use  th(^  recorded  reasons  to  draw 
as  many  conclusions  as  the  reason(!r  needs. 

One  coasequence  of  the  incompleteness  and  incorrecliKss  of  rc'asons  is  that  beliefs  of  the  system 
may  be  incoasistent  in  routine  operation.  The  overall  set  of  beliefs  may  exhibit  inconsistencies  by 
including  conflicting  beliefs  from  different  locales.  Ordinarily  the  specialized  beliefs  corresponding 
to  specific  problems  or  subjects  will  be  represented  in  locales  that  are  internally  consistent,  but  the 
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RMS  need  not  be  forced  to  keep  <all  these  locales  consistent  with  each  other.  But  inconsistency  can 
arise  even  within  a  locale  if  too  little  inference  is  specified. 

Another  consecpience  is  that  the  beliefs  of  the  system  may  not  be  fully  grounded.  In  the  first 
place,  the  set  of  beliefs  may  be  so  large  cT-s  to  mak(^  glol^al  groundedness  too  costly.  More  fundamen¬ 
tally,  large  sets  of  beliefs  always  contain  interderivable  sets  of  propositioas— alternative  definitions 
provide  the  most  common  example — and  which  of  these  sets  to  choose  as  axioms  can  depend  on  the 
specific  reasoning  task  being  addressed.  For  example,  the  standard  definition  of  nonplanar  graphs 
is  best  for  some  purposes  (e.g.,  teaching  the  concept),  but  Kuratowski’s  characterization  is  best  for 
other  purpo.ses  (e.g.,  recognition  algorithms).  Thus  lack  of  global  groundedne.ss  need  not  be  cau.se 
for  alarm.  Ordinarily,  however,  specialized  locales  corresponding  to  specific  problems  will  be  kept 
grounded  in  the  axioms  formulating  these  problems.  The  system  of  beliefs  can  thus  be  thought  of 
as  “islands”  of  groundedness  floating  in  a  S(^a  of  ungrounded  beliefs. 

Since  reasons  merely  record  some  of  the  inferential  history  of  the  reasoner,  they  do  not  by 
themselves  determine  whether  conseciuences  are  updated  or  supports  are  checked.  Instead,  to 
make  these  decisions  the  RMS  ases  annotations  supplied  by  the  rea.soner  which  give  instructions, 
expectations,  and  preferences  about  alternative  courses  of  at'tion.  These  include  specification  of 
the  conditions  under  which  the  RMS  should  pursue  con.setiuences  and  check  support.  For  example, 
local  propagation  may  be  expressed  a.s  procc.ssing  changes  within  the  locale  containing  the  changed 
belief,  but  not  externally.  Alternatively,  changes  might  be  communicated  to  neighboring  locales 
(with  or  without  local  propagation).  Other  regimes  are  possible  too,  including  the  extreme  of 
propagating  the  change  glol)ally.  Similarly,  the  annotation.s  may  indicate  to  per.sist  in  believing  the 
proposition  without  reevaluating  the  supporting  rea.son,  to  check  that  the  reason  is  not  invalidated 
by  beliefs  within  the  containing  locale,  or  to  check  validity  with  respect  to  external  beliefs.  We 
have  developed  in  [7]  and  [1 1]  a  formalization  of  this  more  general  framework  of  reason  maintenance 
that  permits  local  variability  of  con.se(iuential  import,  groundedness,  and  other  properties  of  RMS 
states. 

It  is  this  limited  .scope,  variety,  and  fiin?  grain  of  RMS  opt'ralions,  that  makes  RMS  choices 
(which  reasons  to  use  in  reconstructing  results,  whether  to  prop.agate  changes,  whether  to  ground 
a  conclusion,  and  whether  to  backtrack)  amenable  to  rational  control.  For  decisions  about  up¬ 
dating  con.sec|uences  and  checking  support,  it  is  important  that  the  individual  operations  be  well- 
characterized  computationally.  Domain- knowledge  of  probabilities  and  preferences  should  also  be 
reflected  in  the  revision  policies.  Because  such  information  is  not  always  available,  the  architecture 
provides  default  choices  for  each  of  these  cla.sses  of  decisions.  Each  domain  may  override  these  with 
other  defaults  that  are  more  aiipro|)riate  in  its  specific  area.  These  default  choices  are  then  used 
whenever  there  is  no  evidence  that  a  decision  requires  special  treatment. 

4  Implementation  concepts 

We  implemented  a  prototype  of  the  new  RMS  in  CLOS,  the  Common  Lisp  Object  System.  In  this 
section,  we  describe  the  primary  structures  and  operations  of  the  implementation. 


4.1  RMS 

The  RMS  consists  of  a  set  of  locales,  a  set  of  procedures  for  operating  on  locales,  and  a  .set  of 
mechani.sms  for  communicating  witli  tin*  (external  world.  "^1  hi.s  organization  i.s  dis|)layed  in  Figure 
2.  Some  of  the  locales  contained  in  the  RMS  an*  pc.rsinlent,  that  is,  constitute  permanent  (or  at 
least  long-term)  representations  evolving  over  time.  But  other  locale^s  are  ephetne.ral,  constructed 
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Figure  2:  The  organization  of  a  reason  maintenance  server. 


by  tlie  RMS  during  revision  processes  tliat  expect  to  take  sotne  time  to  finish  and  seek  to  make  no 
changes  in  the  persistent  structures  until  tlieir  computations  are  complete. 

4.2  Locales 

Locales,  in  turn,  consist  of  sets  of  Jiodes  and  information  about  nodes,  principally  reasons  and 
stipnlations.  Locales  represent  contexts  of  reasoning,  so  in  principle  they  should  be  organized 
hierarchically,  with  some  locales  having  sublocales,  etc.  In  the  present  architecture,  however,  this 
hierarchy  is  flattened,  as  the  communication  protocols  among  locales  is  the  same  whether  they  are 
related  to  each  other  or  not,  so  locales  have  no  explicit  suhlocales.  Figure  3  displays  the  organization 
of  a  locale.  Currently  the  incoming  message  ([ueues  of  locales  are  trivial,  as  since  the  actions  are 
all  fairly  trivial  (as  explained  below,  they  presently  include  only  reason  and  stipulation  creation 
and  status  change  signals),  there  is  no  compelling  reason  not  to  just  execute  them  directly.  More 
general  versions  should  reinstate  the  organization  used  in  our  original  implementation,  in  which 
these  ([ueues  are  nontrivial  agendas.  With  such  an  organization,  the  locales  and  RMS  processing 
sites  bear  some  resemblance  to  the  LMC  architecture  developed  to  good  effect  by  Pollack  et  ai 
[24], 

4.3  Nodes 

Nodes  consist  of  both  information  about  the  relations  between  the  node  and  external  objects, 
locales,  and  other  nodes,  and  information  about  this  relational  information  itself. 

The  first  purpose  of  a  node  is  to  denote  some  object,  in  most  cases  external  to  the  the  locale 
and  the  RMS.  This  object  is  called  the  original  or  referent  of  the  node.. 

The  node  also  records  three  lists  of  relations  holding  between  the  node  and  other  nodes.  The 
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Figure  3:  Hie  operational  structure  of  RMS  locales. 


list  of  the  node’s  dependencies  indicates  a  set  (possibly  empty)  of  dependencies  that  depend  on  the 
node  in  some  way;  the  list  of  the  node’s  determiners  indicates  relations  that  potentially  determine 
the  status  of  the  node;  and  the  node’s  determiner^  if  the  node  is  in,  indicates  the  element  of  the 
list  of  determiners  that  the  RMS  identifies  as  determining  the  status  of  the  node.  If  the  node  is 
out,  there  is  no  identified  determiner. 

The  node  has  two  binary  flags  which  indicate  both  whether  its  referent  is  included  in  the  current 
view  provided  by  the  locale,  and  whether  this  inclusion  is  correct  or  possibly  incorrect.  The  first 
flag  is  the  support  labels  which  is  either*  in  or  only  meaning  that  the  referent  is  either  in  or  out  of 
the  current  view  provided  I)y  the  node’s  locale.  The  second  flag  is  the  label  statusy  which  is  either 
certain  or  uncertairiy  meaning  that  the  support  label  correctly  reflects  the  support  provided  by  the 
determiners  or  may  not  correctly  reflect  the  support  provided  by  the  determiners.  In  the  original 
RMS,  of  course,  the  support  label  was  in  if  and  only  if  the  node  had  a  valid  determiner,  but  in  the 
new  RMS,  the  possibility  of  incomplete  updates  means  that  a  node  can  l)e  in  even  if  no  determiner 
is  valid,  and  can  be  be  out  even  if  some  determiner  is  valid.  (It  is  worth  noting  that  even  the  original 
RMS  employed  the  label  status  flag,  but  only  during  revision  comt)utations;  control  was  passed 
back  to  the  external  system  using  the  RMS  only  after  all  support  labels  had  been  determined  with 
certainty.) 

One  other  binary  flag  is  used  to  mark  those  nodes  that  should  not  be  included  in  current  views. 
Nodes  so  marked  are  called  contrudictions  after  the  familiar  logical  notion  of  a  statement  that 
should  not  be  held.  This  nomenclature  is  somewhat  misleading  in  the  RMS,  however,  as  nodes  so 
marked  need  not  even  represent  beliefs;  instead,  tliey  are  simply  things  that  should  not  be  made 
part  of  the  view  represented  by  a  locale. 

The  RMS  also  provides  for  one  iinportant  type  of  node,  namely  propositions.  These  may  be 
used  to  stand  for  logical  i)ropositions,  and  differ  from  other  nodes  only  in  that  they  have  an 
associated  negatioiiy  which  is  another  node  (in  fiict,  also  a  proposition)  representing  the  negation 


of  the  proposition  node. 

4.4  Reasons  and  Stipulations 

We  use  the  term  dependency  to  mean  any  records  stored  by  the  RMS  of  relationships  holding  among 
nodes.  These  include  the  records  stored  with  a  node  as  the  node’s  dependencies  and  determiners. 
In  their  most  general  form,  dependencies  are  nondirectional  and  nonspecific;  they  .serve  mainly  as 
an  indication  of  relevance  rather  than  as  specific  directives  to  action.  The  implementation  of  the 
RMS  provides  a  hierarchy  of  subtypes  of  dependencies,  as  detailed  below,  but  makes  substantial 
use  of  only  two  subtypes  at  present;  snpporl-lisl  reasons,  which  indicate  nonmonotonic  argument 
or  derivational  steps,  and  sliptdalions,  which  indicate  observations  or  communications  from  outside 
the  node’s  locale. 

There  are  two  main  subtypes  of  dependencies:  determiners  and  influences.  A  determiner  is  a 
dependency  that  determines  status  labels  of  one  or  more  nodes,  while  an  influence  is  somewhat 
more  general  and  indicates  that  a  .set  of  antecedent  nodes  influence  a  set  of  consequence  nodes  in 
.some  way.  Neither  of  these  main  subtypes  is  used  directly;  instead,  the  RMS  really  exploits  more 
special  subtypes  of  each. 

The  subtypes  of  determiners  provided  by  the  RMS  are  as  follows: 

•  A  node- determiner  is  a  dependency  that  determines  a  single  node’s  status. 

•  A  reason  is  a  node  determiner  that  provides  a  rea.son  for  tlie  node.  There  are  several  tyi)es 
of  reasons.  Each  reason  has  a  defeating  node,  which  if  in  makes  the  reason  invalid. 

•  A  SL-reason  (or  support-list  reason)  is  a  reason  that  expre.sses  support  in  terms  of  two  lists 
of  nodes,  an  inlist  and  an  outlist,  and  is  valid  just  in  case  each  node  of  the  inlist  is  in  and 
each  node  of  the  outlist  is  out. 

•  A  CP-reason  (or  conditional-i)roof  reason)  is  a  reason  that  expres.ses  support  in  terms  of  the 
derivability  or  arguability  of  one  node  from  others,  as  in  a  conditional  proof  or  hypothetical. 
The  current  RIVIS  implementation  permits  the.se  to  be  defined,  but  does  not  proce.ss  them  at 
present,  as  they  significantly  increase  the  complexity  of  the  algorithms. 

•  A  stipulation  is  a  node-determiner  that  simply  stipulates  the  lal>el  of  a  node,  providing  no 
reason. 

•  A  clause  is  a  determiner  indicating  that  at  least  one  member  of  a  list  of  proposition  nodes 
must  be  in.  This  is  intended  to  be  u.sed  roughly  in  the  ways  one  u.ses  disjunctive  clauses  in 
logical  reasoning. 

As  noted  above,  the  prototype  implementation  concentrates  on  SL-reasons  and  stipulations,  and 
provides  only  incomplete  handling  for  the  other  types  of  determiners. 

The  main  form  of  influences  u.sed  in  the  RMS  at  present  are  signals,  which  effect  communications 
among  locales  within  an  RMS,  and  communication  between  an  RMS  and  external  systems.  The 
RMS  and  systems  using  the  RMS  associate  with  each  type  of  signal  a  jirocedures  that  performs  the 
appropriate  signalling  action  (possibly  conditional,  possibly  null)  wlum  invoked  by  the  RMS.  The 
subtypes  of  signals  provided  by  the  RMS  are  as  follows: 

•  Tell  signals  are  invoked  by  th(!  RMS  whenciver  new  information  is  provided  to  the  RMS.  At 
present,  two  specific  sorts  of  tell  signals  are  defined.  These  indicate  the  addition  of  new 
determiner  information,  namely  the  addition  of  a  new  stipulatioii  or  a  new  reason. 
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•  /l.sA:  sif^iKiIs  an^  iiivokt'd  Wy  L1h»  W.MS  wh,  novor  inlonnatioii  is  iuskcul  ol  Uir  luvib.  i  \\v.  |)i(!S(Ma 
inipleiiientation  provides  no  spcTilic  iisc's  ol  Uh^so  signals. 

•  The  signals  most  exploitiKl  in  tlie  curnmt  im|deinentation  are  relabeling  signals,  which  are 
used,  as  in  th(^  original  RMS,  to  signal  the  changes  in  node  information  following  the  execution 
of  relabeling  procedures.  The.  prin<Mi)al  specific  types  signal  changes  in  a  node’s  support  label: 
recalling  signals  indicate  a  change  from  ont  to  m,  while  forgetting  signals  indicate  a  change 
from  m  to  onL  The  RMS  also  i)rovides  a  more  general  signal  of  conditions.  Each  condition 
signal  includes  a  condition  (expressed  as  a  Lisp  predicate)  that  determines  the  need  to  execute 
the  signal. 

As  noted  above,  at  present  the  main  signals  exploited  in  the  RMS  are  the  recalling  and  forgetting 
signals. 

We  define  a  numlxM*  of  relationships  among  nodes  in  tc'rms  of  their  support  labels  and  tluMi* 
dependencies.  The  basic  relations  are  those  of  antecedents,  supporting  nodes,  conseqnerices,  and 
affected  consequences,  which  arc  d(dined  appropriately  for  each  s[)eciric  type  of  dependency.  1  he 
antecedents,  as  one  might  expect,  are  all  the  nodes  directly  entering  into  the  evaluation  of  the 
dependency,  and  the  conseciuences*  are  th(^  n()d<\s  din^ctly  affecttnl  by  a  determiner  or  influeiu'e. 
The  supporting  nodes  are  the  antecedents  that  actually  determine  the  validity  of  the  node,  given 
the  current  support  labelings,  and  the  afh'cted  consequences  are  the  consef[uences  for  which  the 
node  in  ((uestion  is  a  supporting  luxle  (i.e.,  imtt'rs  into  its  d<*t(*rminer),  /The  otluT  r(»Iationships 
are  defined  in  mainly  in  terms  of  th('S(*  basi(*  ones.  Th<^  believed  consequences  (admittc'dly  a  poor 
name)  consist  of  the  affected  conscxpiences  that  are  m;  the  repercussions  are  found  by  taking  the 
transitive  closure  of  the  believed  conse(|U(mces;  the  foundalioris  are  found  by  taking  tlu^  transitive 
closure  of  the  antecedents;  and  the  a7icesto7's  are  found  as  the  transitive  closure  of  the  supporting 
nodes. 

We  also  distinguish  two  types  of  nodes  based  on  their  determiners.  We  say  that  premises 
are  nodes  that  are  m  with  no  antecedents,  and  that  assu7nptio7is  are  nodes  that  are  in  and  have 
sup[)orting  nodes  that  are  out.  Ordinarily,  w(!  ignores  the  r(\ason-specific  defeater  nodes  iiu'luded 
in  reasons  in  making  these  distinctions.  From  these  two  distinctions,  we  may  further  identify  tlie 
premises  and  assumptions  sup[)orting  a  node,  in  the  sense  of  appearing  in  the  node’s  ancestors. 

Finally,  as  an  aid  to  determining  the  curnmey  of  inforination,  each  d(‘pend(Micy  is  marked  with 
th('  time  it  was  told  to  tlu^  RMS.  FurtluT,  eai'h  nod(^  is  marked  both  with  the*  tinx*  its  lalx'l  was 
last  checked  and  with  th('  tiiix^  of  its  lati'st  (h'terminer,  so  that  tlx^  lalxd  status  of  a  nod('  updati'd 
prior  to  its  most  recent  determiner  is  prvna  facie  uncertain.  Similarly,  locak's  are  markcxl  with  tlx* 
time  of  their  last  update,  and  with  tlx*  time  of  the  most  recent  determiners  provided  to  any  of  their 
nodes. 

4.5  RMS  procedures 

Tlx‘  basic  locale  pro<  edun'  is  one  which  relalx^ls  a  set  of  nock's;  the  wider  variety  of  locale  procedures 
consist  primarily  in  different  ways  of  selc'cting  different  sets  of  node's  for  relabeling. 

The  main  steps  of  the  rc'labc'ling  procedure  are  as  follows: 

•  First,  identify  tlx*  ixxles  to  be  re'labeled  and  create  an  ephemeral  locale  mirroring  them. 

•  Second,  find  all  support  lal)f'ls  detc'rmined  by  .stipulations. 

•  Third,  find  all  support  labc'ls  (k'termiix'd  by  rc'asons. 

•  Fourth,  install  all  tlx'se^  supi)ort  lalx'ls  and  the.  ce>rresponding  determiners. 


ir, 


•  Fifth,  execute  all  relal)elinj!;  signals  for  tluwe  iiod^s. 

We  describe  each  of  these  steps  in  turn,  starting  with  the  sc'coud,  and  describe  the  first  step  last. 

The  method  l)y  which  labels  an?  <l(?t(?rmined  from  stipulati(ms  may  vary  from  node  to  luxh?. 
In  general,  one  should  use  the  most  re(x?nt  stipulations,  but  th(?se  may  conflict.  Each  node?  may 
indicate  a  different  function  for  reconciling  its  stipidations  in  cases  in  which  they  conflict,  l>ut 
so  that  nodes  need  not  always  indicate  such  a  fuu(?tiou,  each  locale  may  indicate  a  function  foi 
reconciling  stipulations  for  its  nodes.  If  neith(?r  the?  node  nor  its  locale  indicate  such  functions, 
the  RMS  default  method  is  iised,  which  is  just  to  u.s(?  the  first  stipulation  recorded  among  tlx? 
stipulations  with  the  most  recent  dat(?s.  (We  allow  that  s(?v(?ral  difr(?rent  pieces  of  information  may 
arrive  at  the  .same  tiuu?,  and  do  not  assume  that  tlx?  RMS  has  a  general  means  to  serialize  tlx?se 
incoming  messages.)  An  alternativ(?  ux?tho<i  provided  is  ux)rc?  coiuservative,  Jind  simply  r(?tains  the 
current  support  label  wh(?u  the  latest  sti|)ulatiou.s  conflict  in  the  lab(?l.s  they  specify. 

The  methotl  by  which  lab(?ls  are  d<?t<?rmiued  from  r(?ason.s  is  akiji  to  traditional  methods  for 
rea.sou  maiiiteuauce;  a.s(?arch  for  admissible  lalx.'liugs  using  tlx?  reasons  as  constraints  on  the  lalx-ls 
assign(?d  to  uo<l<?s.  The  current  imph?nx?ntatiou  us(?s  a  very  simple  .s<?arch  d(?riv<?(l  from  tlx?  algorithm 
iKsed  by  the  original  R.MS. 

The  prototype  RMS  installs  the  results  of  its  r(?visious.by  simply  .setting  the  support  lain?!  and 
determiners  of  the  nodes  it  has  examined  to  the  ix?wly  d(?t(?rmined  vahx?s.  One  can  (;outempliit<* 
more  refined  methods  for  the  distributed  asynchronous  (?uviroument  in  which  the  RMS  first  che<  k.s 
to  see  if  any  of  the.se  nodes  have  r(?ceived  new  lal)els  or  information  in  tlx?  iut(?rv(?ning  time?,  and 
then  treats  these  nodes  differently,  but  siurh  more  n'fiix’d  ux?thod.s  remain  to  lx?  .studi(?d. 

The  RMS  executes  tlx?  relabcding  signals  by  (?valuating  the  conditions  appropriate  to  all  signals 
attached  to  nodes  under  revision  and  then  ex(?(?uting  tlx?  asso(?iaU?tl  signalling  proc(?dures  for  all 
signals  with  valid  conditions. 

As  stated  previously,  one  of  the  main  aims  for  tlx?  new  RMS  is  to  avoid  the  approach  tak(?n  in 
the  original  RMS  and  to  make  more  informed  decisions  about  wlx?tlx?r  ix?w  information  calls  for 
revisions,  and  the  extent  of  the.se  revisions  if  .so.  '^I'lx?  !x?w  RMS  mak{?.s  first  st**ps  towards  addr(?ssing 
this  aim  by  provirling  an  array  of  revision  [)roc(?dur(?s  as  alternativ<?s  to  tlx?  revision-extent  d(?cision. 
These  alternative  revision  procedures  art?  as  follows; 

•  The  .simph?st  {)rocedure  revises  a  siugh?  noth?.  'I’his  aux)unts  to  simply  r(‘consid(?ring  its  current 
set  of  determin(?rs  and  re.setting  it  supi)ort  label  to  the  lalx'ling  justified  by  these  d(?t<‘rurux‘rs. 
The  signals  attached  to  tlx?  noth?,  if  any,  are  tlx?n  <>xecut(?d.  'Phis  simplest  |)roc(;dur(?  takes 
little  time,  and  oft(?n  is  all  that  is  need«?d,  esp*?cially  for  providing  an  initial  lalx?rmg  for  ix?wly 
creat(?d  ix)d(?.s  r(?coiving  tlx?ir  first  reason  or  stipulation.  Howev(?r,  if  u.sed  to  the  exclusion  ol 
more  compr(?hensiv(?  ux?thods,  it  produc(?.s  kx'ales  with  .somewhat  incolx'n?ut  lalx?rmgs. 


•  A  similar  [U’oeedurt?  r(?vi.s(?s  a  giv(?n  s«?t  of  ixxles.  'I'lx?  only  difrer(?ix;e  is  that  in  this  case  tlx* 
eplx?meral  l(x;al(?  contains  tlx?  giv(‘n  set  ratlx?r  than  just  one  nexh?. 

•  'I'lx?  ix?xt  simplest  pr(x:(;dur(?  r(?vi.ses  an  (?ntir(?  kxrale.  'I'his  is  done  by  giving  all  the  nod(?s  of 
the  locale  to  the  ix)d(?-set  r(?labling  procedun?  j)ist  d(?.s(;ribed. 


•  d'he  original  RMS  relabled  only  tlx?  afrect(;d  con.s(?(iix?ix:('S  of  .single  niMle.s,,  atxl  the  ix?w  RMS 
provi(l(?.s  corr(?s|)onding  capabiliti(?s  in  pi'oc(?dures  that  r<?vis<?  (*ither  the  iminediatt?,  tlx?  local, 
or  tlx?  global  con.s(?<iuences  of  sc?ts  of  nodes.  In  the  immediate  pnx  ediin-,  tlx?  RMS  collects  up 
only  the  immediate?  con.s»‘<ineix-es  of  tlx?  initial  ixh1(?s;  in  tix?  local  pnM  e<lur«?s,  only  the  aff(?cted 
con.s(‘(nx?nc(‘s  that  (?xist  within  tlx?  same  l(x-al<?s  as  the  initial  nixie's;  aix!  in  the  global  prexe*- 
elure-s,  the?  RMS  e;olle‘e;t.s  uj)  all  aflee;te?d  e-onsi‘nui‘nce‘S,  e  haining  through  all  fe>cafe‘S  if  niscR.siiry. 
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One  of  the  more  interesting  avenues  for  extension  of  the  RMS  involves  developing  incremen¬ 
tal  versions  of  such  procedures  that  make  informed  node-by-node  decisions  about  whether  to 
pursue  consequences  further.  This  would  provide  a  large  spectrum  of  possible  consequential 
revision  operations  instead  of  the  three  provided  in  the  prototype  implementation. 

•  Since  the  original  RMS  always  presented  well-founded  arguments  for  all  labelings,  it  only 
needed  to  revise  the  antecedents  of  nodes  when  contradictions  were  discovered  that  required 
removing  some  of  the  grounds  for  holding  a  contradiction  node.  But  in  the  new  approach, 
in  which  labelings  need  not  be  completely  coherent,  it  is  necessary  to  provide  means  by 
which  the  support  for  a  node  can  be  verified  prior  to  using  the  node  to  take  significant 
actions.  Accordingly,  the  final  class  of  relabeling  procedures  provided  by  the  new  RMS 
revise  either  the  immediate,  local,  or  global  antecedents  of  an  initial  set  of  nodes,  with  these 
variations  involving  distinctions  exactly  like  the  immediate,  local,  and  global  consec[uences 
just  discussed. 

In  addition  to  relabeling  or  update  procedures,  the  RMS  provides  a  variety  of  other  procedures 
as  follows: 

•  The  tell  procedures  provide  means  for  providing  information  to  the  RMS.  These  procedures 
may  be  used  to  create  new  locales,  nod(^s,  reasons,  or  stipulations,  and  to  mark  nodes  as 
contradictions. 

•  The  ask  procedures  provide  means  for  obtaining  information  from  the  RMS.  These  procedures 
may  be  used  to  retrieve  the  support  label,  label  status,  determiner,  and  the  nodes  standing 
in  any  of  the  derived  relationships  (antecedents,  con.sequences,  etc.)  to  a  given  node. 

•  The  backtracking  procedures  provide  the  RMS  tlie  ability  to  attempt  to  make  specific  contra¬ 
diction  nodes  out. 


5  Market-guided  reason  maintenance 

The  new  RMS  described  above  provides,  the  means  for  making  |)artial  revisions  to  information  and 
views  distributed  throughout  interconnected  locales,  but  docs  not  itself  provide  guidance  almut 
which  revisions  to  effect.  In  this  section,  we  discuss  the  approach  of  using  artificial  markets  to 
allocate  effort  for  distributed  revisions  and  replanning,  and  extcuid  the  basic  RMS  to  a  market- 
guided  RMS. 

5.1  Market  allocation  of  resources 

Efficient  allocation  of  resources  constitutes  ati  important  special  case  of  both  result  and  process 
rationality.  In  transportation  planning,  for  example,  efficient  allocation  of  transportation  resources 
to  transportation  tasks  constitutes  result  rationality,  while  efficient  allocation  of  planning  resources 
to  solving  competing  transportation  ])roblems  constitutes  process  nationality.  Such  competition 
between  planning  problems  occurs  freciuently.  Large-scale  activities  usually  involve  several  organi¬ 
zations  or  authorities,  each  placing  demands  on  its  own  and  other  resources,  and  these  competing 
organizations  often  generate  int(*rna]  competitioris  as  well,  as  they  distribute  information  and  au¬ 
thority,  both  geographically  (different  theaters  of  operation  or  manufacturing  or  clinic  locations) 
and  functionally  (si)ecial-purpose  databases  and  departments),  in  order  to  satisfy  legal,  regulatory, 
privacy,  reliability/redundancy,  or  efficiency  (e.g.,  communication  or  computational)  considerations. 
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The  overall  success  of  large-scale  planning  activities  often  retiuires  managing  these  competing 
demands  effectively  to  coordinate  the  component  efforts,  and  recognizing  that  computational  and 
communication  resources  must  bo  allocated  along  with  fiK;!,  diagnostic  equipment,  repair  personnel, 
and  other  more  visible  goods.  Com|)utation  and  communication  may  seem  “free”  once  one  makes 
these  resources  available,  but  their  use  always  involves  opportunity  costs.  For  example,  computing 
more  to  improve  one  partial  plan  may  save  a  flight  and  its  associated  fuel  and  pilot  costs,  while 
computing  more  to  improve  another  partial  plan  may  save  more  lives.  But  one  cannot  simply  just 
decide  what  computations  to  make  by  comparing  the  non-com putational  goods  at  issue  because 
some  computations  (e.g.,  creating  a  fast  local  database)  can  speed  or  improve  other  computations, 
thus  representing  non-computational  goods  only  indirectly. 

The  usual  approach  taken  to  managing  these  competitions  is  bureaucratic,  with  some  central 
or  higher  authorities  attempting  to  make  broad  allocations  of  resources  and  rec(uiring  the  different 
organizations  and  their  components  to  operate  within  these  allocations  and  to  explicitly  reciuest 
reallocations  if  such  operation  becomes  impassible.  Unfortunately,  bureaucratic  management  of 
the  resources  for  complex  activities  is  too  inflexible  to  meet  the  ordinary  flow  of  events,  which 
continually  undermines  the  assumptions  underlying  such  allocations  by  changing  the  demands  on 
component  organizations  in  ways  difficult  to  predict  by  central  planners.  In  particulai,  the  mo.st 
important  competition  for  resources  is  not  a  static  competition  among  relatively  permanent  organi¬ 
zations  and  their  components;  instead,  the  most  important  competition  for  resources  is  among  an 
ever-changing  set  of  tasks  and  portions  of  the  overall  activity.  This  competition  arises  as  changing 
circumstances  undermines  portions  of  the  plans  of  the  organizations  involved  in  the  activity.  To 
deal  with  these  changing  circumstances,  the  organizations  and  their  components  must  continually 
repair  the  plans  directing  their  current  activities,  and  the  result  is  that  the  most  impoitant  com¬ 
petition  for  resources  is  the  competition  among  portions  of  the  overall  plan  for  the  attentions  of 
the  authorities  engaged  in  the  activity.  This  competition  is  dynamic,  cutting  across  organizational 
lines  and  changing  much  more  rapidly  than  the  structures  of  the  organizations  themselves  (even 
when  the  organizations  dynamically  form  teams  to  deal  with  problems).  Bureaucratic  management 
of  resources  does  not  appear  adecpiate  to  deal  with  the.se  dynamic  re.source  competitions. 

To  manage  large-scale  planning  activities  and  their  dynamic  resource  competitions  effectively, 
we  must  seek  to  address  the  competition.s  among  ta.sks  directly  rather  than  indirectly  through  a 
fixed  matrix  of  organizations.  Instead  of  focussing  on  a  fixed  array  of  organizations  ancl  their 
capabilities,  we  must  focus  on  the  changing  .set  of  tasks,  the  importance  of  these  tasks  to  each  other 
(as  accomplishing  one  task  may  facilitate  or  impede  another),  and  the  relevance  of  the  organizational 
capabilities  to  each  task.  The  cpicstion  then  becomes  how  to  allocate  re.sources  to  tasks,  with  the 
allocation  of  resources  to  organizations  derived  from  the  i)rimary  task-centered  allocation. 

The  field  of  economics  has  a  well-known  answer  to  the  problem  of  allocating  resources  to  tasks: 
use  markets.  It  suggests  viewing  the  competition  for  resources  in  terms  of  resource-endowed  con¬ 
sumers  that  represent  tasks  or  goals  of  the  activity  and  resource-transforming  producers  that  repre¬ 
sent  computational  or  reasoning  procedirres,  informational  resources,  or  noncornputational  agents. 
Equilibrium  (“market”)  prices  correspond  to  allocations  of  resources  to  tasks  that  balance  supply 
and  demand,  thereby  ranking  particular  re.source  demands  by  their  importance  relative  to  other- 
needs  and  the  activity’s  ability  to  supply  or  produce  the  re.sources. 

Economics  bases  its  market  prescription  on  practical,  theoretical,  and  organizational  grounds. 
In  practice,  markets  for  many  goods  provide  extremely  rapid  response  to  changing  circrrrnstances 
(as  ob.servation  of  commodity  markets  shows)  as  well  as  fl(!xibl<!  and  ineasunHl  r  e.spotrscs  to  (hanging 
demands  (which  is  not  to  say  that  overreactions  are  not  i)o.ssible).  For  a  sizable  r-ange  of  important 
goods,  markets  empirically  pi’ovide  the  b(!st  known  method  (>f  allocation,  even  to  the  point  of 
springing  up  and  supplanting  more  Imreaucratic  mechanisms  when  not  effectively  sui»pre.ss(i'd.  In 
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addition,  economic  theory  proves  markets  to  he  the  most  efficient  allocation  mechanisms  possible, 
in  the  sense  that  the  allocations  determined  l)y  markets  best  satisfy  the  preferences  of  the  agents 
involved.  And  markets  do  this  while  making  smaller  demands  on  the  organizational  structure  of  the 
activities  using  the  resources,  as  they  depend  mainly  on  the  calculations  of  the  individual  agents 
or  organizational  components  competing  for  resources  rather  than  on  any  calculation  by  central 
planning  authorities. 

Markets  thus  seem  highly  suited  to  complex  resource  allocation  problems,  as  they  do  not  re¬ 
quire  synoptic  computational  abilities  and  still  achieve  the  best  possible  results.  But  their  use  in 
organizing  activities  lias  been  limited  for  several  reasons,  especially  the  difficulty  of  recognizing 
competitions  in  a  timely  fashion  and  of  tracking  the  wide  variety  of  material  and  non-material 
goods  involved  in  some  activities.  That  is,  markets  in  diesel  fuel  persist  and  succeed  because  diesel 
fuel  is  a  commodity  used  by  many  agents  over  long  periods  of  time,  has  very  slowly  changing  or 
highly  predictable  properties,  and  is  arbitrarily  divisible,  with  different  batches  distinguished  only 
by  their  size,  not  by  other  qualities.  In  contrast,  it  is  difficult,  at  least  within  traditional  orga¬ 
nizational  structures,  to  recognize  the  need  for  a  market  in  strategies  to  repair  a  transportation 
plan  upon  the  closure  of  an  airfield,  much  less  to  identify  the  organizational  agents  tliat  might 
appropriately  enter  into  such  a  market.  In  consequence,  traditional  approaches  to  organizing  large 
scale  activities  mix  market  and  other  mechanisms.  The  activities  em()loy  markets  for  resources 
when  those  markets  already  exist  and  are  conveniently  acce.ssed  by  the  component  organizations, 
but  use  bureaucratic  or  other  non-market  mechanisms  for  the  structuring  the  larger  part  of  the 
activity.  Traditional  approaches  thus  are  denied  the  benefits  of  market  allocation  for  many  parts 
of  their  activities. 

Although  virtually  all  traditional  architectures  for  computational  and  intelligent  systems  have 
been  based  on  the  bureaucratic  model,  limited  forms  of  computational  markets  go  back  a  long 
way  in  computer  science;  one  can  even  view  some  of  the  early  job-scheduling  procedures  for  batch 
processing  as  implementing  a  “market”  in  computation  for  which  users  “bid”  by  means  of  com¬ 
mands  on  their  job-control  cards  (punched  cards,  that  is).  But  the  true  flowering  of  computational 
markets  has  occurred  only  recently,  mainly  with  the  WALB  AS  computational  economy  developed 
by  Wellman  [30].  Designed  to  make  use  of  th(^  main  ideas  of  theoretical  economics  about  mar¬ 
kets,  WALRAS  provides  a  general  mechanism  for  implementing  markets  in  arbitrary  sets  of  goods, 
traded  by  arbitrary  consuming  and  j^roducing  agents.  WALRAS  provides  the  basic  market  notions 
of  consumer  and  producer  agents,  goods,  and  auctions  for  these  goods.  Each  consumer  and  pro¬ 
ducer  enters  into  a  subset  of  the  auctions.  Consumers  are  endowed  (possess)  bundles  of  various 
goods,  and  enter  into  the  auctions  for  each  of  the  goods  in  their  endowment.  Producers  do  not 
possess  goods,  but  instead  transform  a  set  of  input  goods  into  an  out|)ut  good,  and  enter  into  the 
auctions  for  their  input  and  output  goods.  Consumers  and  producers  place  bids  in  each  of  the 
auctions  in  which  they  participate.  These  bids  may  be  <as  simple  as  indicating  the  desire  to  trade 
a  specific  quantity  of  the  good  at  the  current  [)rice;  or  as  complex  as  a  full  schedule  of  amounts 
to  trade  (buying  or  selling)  at  each  possible  price.  Consumers  and  producers  determine  their  bids 
in  different  ways.  Consumers  have  a  utility  function  or  preference  order  over  possible  bundles  of 
goods,  and  bid  so  as  to  trade  a  less  preferred  bundle  for  a  more  i)referred  bundle.  Producers  have 
a  production  function  that  describes  how  much  outpiit  derives  from  each  bundle  of  inputs,  and  use 
this  production  function  to  determine  bids  for  input  goods  from  prices  for  output  goods  or  vice 
versa.  WALRAS  determines  eciuilibrium  prices  by  an  iterative  proce<lure  that  at  each  iteration 
determines  the  total  sui)ply  and  demand  for  each  good  at  current  prices  and  adjusts  the  prices 
accordingly  if  supply  and  demand  do  not  matcli.  In  observations,  WALRAS  computes  ecpiilibrium 
or  near-equilibrium  prices  in  only  a  few  iterations.  WALRAS  makes  a  ntimber  of  special  economic 
assumptions  about  agents,  the  most  important  one  being  tliat  agents  are  “price  taking”,  that  is,  no 


19 


agent  is  large  enough  in  the  market  to  influence  prices  simply  by  its  own  actions.  This  assumption 
is  actually  not  true  in  many  of  the  small  reasoning  markets  of  interest,  but  its  failure  has  not 
yet  been  shown  to  matter  in  practice  clue  to  the  iterative  nature  of  ecpiilibriation.  WALRAS  thus 
provides  a  mechanism  for  implementing  markets  in  goods  as  they  appear  and  disappear,  as  long  as 
one  can  identify  the  need  for  such  markets  and  the  participants  in  them. 

5.2  An  experimental  market-guided  RMS 

In  order  to  provide  rational  guidance  to  distributed  reason  maintenance  activitie.s,  we  constructed 
a  market-guided  RMS,  called  MRMS,  by  combining  the  new  RMS  with  an  extension  of  WALRAS. 
MUMS  represents  each  significant  revision  task  by  means  of  a  market  good  and  a  consumer  of  that 
good,  and  each  revision  method  by  a  producer  of  a  revision  good.  Effort  is  then  allocated  among 
the.se  tasks  on  the  basis  of  relative  prices  of  these  goods. 

The  “glue”  used  in  this  combination  is  a  system  called  RECON,  the  Reasoning  ECONomy. 
The  reasoning  economy  extends  WALRAS  and  determines  rational  allocations  of  the  full  range  of 
resources,  computational  and  otherwise,  by  determining  prices  or  trading  ratios  among  resources. 
RECON  builds  on  WALRAS  by  augmenting  WALRAS‘s  generic  notions  of  goods,  consumers, 
or  producers  with  notions  specific  to  reasoning  tasks,  and  by  introducing  computation  goods  to 
allocate  to  different  tasks.  Its  main  additions  to  WALRAS  are  a  good  representing  computation, 
the  notions  of  computation  consumers  and  producers,  a  taxonomy  of  action  types,  and  an  execution 
mechanism  that  takes  actions  in  an  ord(!r  determined  by  bids  for  computation. 

The  taxonomy  of  action  types  introdu('(!S  Lh(‘  distinction  betw(K*n  actions  and  states,  and  dif¬ 
ferentiates  a  standard  variety  of  action  types  reflecting  mainly  planning  and  reason  maintenance 
actions  (labeling,  signalling,  etc.).  Base  level  actions  have  associated  |)rocedures. 

We  have  explored  two  approaches  to  allocating  computational  resources.  Our  initial  approach 
was  based  on  an  auction  of  computation  opportunities,  while  a  later  approach  developed  by  our 
student  Nathaniel  Bogan  [1]  conducts  auctions  to  rent  computational  resources  to  the  highest 
bidders. 

The  initial  RECON  implementation  schedukxl  tasks  on  a  single  processor  by  auctioning  off 
opportunities  to  compute.  In  this  implementation,  comi>utation  consumers  and  producers  bid  for 
amounts  of  the  computation  good  as  though  they  were  bidding  for  different  amounts  of  time.  Com¬ 
putation  consumers  have  a  computation  function  in  addition  to  their  utility  function,  where  their 
computation  function  indicates  their  use  of  computation  in  diffcirent  circumstances.  Computation 
producers  take  computation  as  input  and  produce  outputs,  with  diff(frent  subtypes  of  computa¬ 
tion  producers  characterized  by  their  computation  production  functions  that  indicate  how  much 
computation  they  take  to  i)roduce  their  results  (i.e.,  their  running  lime).  WALRAS  is  then  run  sev¬ 
eral  steps  towards  eciuilil)rium  i)ri(es,  with  the  r(!sulling  non-(?ciuilibrium  prices  used  lioth  becau.se 
ec[uilibria  need  not  exist  with  the  discr(!t(i  bidding  scheduhw  n.sed  in  MRMS  and  becau.se  finding 
them  may  take  too  long  even  when  they  do  exist.  'Fhe  RECON  execution  mechanism  schedules 
the  execution  of  primitive  procedures  by  using  the  l)ids  each  procedure’s  producer  bids  for  com¬ 
putation.  However,  though  the  bids  reflect  the  amounts  of  computation  desired  by  consumers  and 
producers,  the  execution  mechanism  in  fact  provides  uninterrupted  opportunities  to  compute  as 
long  as  desired  (po.ssibly  forever)  ratlKir  than  the  op|)ortunity  to  com|)ute  only  as  much  as  the  bid 
specified.  The  selection  of  th(!  prodnccu’  to  execute  is  made*  l)y  oiuf  of  s<‘V(>ral  methods,  the  sim- 
[)lest  l)eing  to  simply  pi(k  the  protliu'fM’  l)idding  lor  th(!  nuixiinuni  amount  of  computation  among 
all  producers  bidding  for  computation.  This  corresponds  intuitively  to  taking  actions  to  make  as 
much  progress  as  possible  at  each  step.  Following  each  action,  i)roducers  and  the  consumers  they 
serv(i  are  charg(Kl  for  th(!  computation  consiniK^d  once;  a  |)roducer’s  proetKhm^  is  executed.  Due  to 
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the  use  of  non-equilil)riuni  prices,  tliese  charges  may  bankrupt  consumers.  On  the  theory  tliat  most 
reasoning  consumers  correspond  to  goals  that  need  not  be  pursued  further  once  achieved,  RECON 
seeks  to  speed  future  decisions  by  “garlmge  collecting’’  bankrupt  or  otherwise  useless  consumers 
and  producers  from  the  economy  when  these  charges  remove  all  the  endowment  of  consumers. 

Nathaniel  Bogan  developed  an  improved  version  of  RECON  by  incorporating  several  standard 
approaches  from  economic  theory  and  practice  [1].  In  his  scheme,  consumers  and  producers  bid 
rental  prices  for  computational  resources  (e.g.,  processors),  and  RECON  allocates  time  to  those 
producers  offering  the  highest  rental  rates  (in  the  non-equilibrium  approximation).  The  winner  is 
then  charged  at  this  rate  according  to  how  much  time  it  actually  uses. 

We  developed  MRMS  on  the  basis  of  the  initial  RECON  version  described  above.  Fairly  simple 
estimates  of  costs  were  used  instead  of  more  accurate  (and  possibly  statistical)  analyses  in  describing 
production  functions.  We  then  tested  MRMS  in  a  simple  problem-solving  context  using  only  simple 
all-or-nothing  preferences  for  the  tasks.  Even  this  simple  setting  revealed  interesting  behavior. 
Varying  the  amount  of  computation  reciuired  by  the  basic  reason  maintenance  procedures  relative 
to  each  other  yielded  series  of  reasoned  updates  either  being  ])erformed  sequentially  as  individual 
revisions  (which  take  little  time  but  may  leave  the  network  of  justifications  somewhat  incoherent), 
or  being  performed  indirectly  by  avoiding  any  revision  during  the  incoming  series  but  revising  the 
entire  set  at  once  in  a  larger  update  operation  at  the  end  (which  can  take  more  time  but  leaves 
the  network  of  justifications  mutually  coherent).  This  illustrates  one  of  the  strenths  of  the  market- 
oriented  approach:  tasks  which  have  implications  for  many  other  tasks  are  automatically  accorded 
great  importance,  in  some  cases  ev(m  more  than  tasks  that  are  very  important  on  their  own.  These 
determinations  derive  purely  from  the  information  local  to  ofich  task  and  method  and  from  the 
pattern  of  interaction  of  the  tasks  and  methods  as  reflected  in  the  market  topology.  There  is  no 
need  to  apply  specific  knowledge  to  recognize  the  importance;  the  market  mechanisms  provide  that 
indication  automatically. 

6  Representing  planning  and  reasoning  preferences 

Preferences  constitute  one  of  the  basic  elements  of  information  about  economic  agents,  and  a  key 
problem  in  both  our  investigation  of  market-guided  reason  maintenance  and  in  rational  planning  in 
general  is  finding  a  good  representation  of  preference  information.  Decision-theoretic  treatments  of 
preferences  represent  the  objectives  of  a  decision  maker  by  an  ordering  over  the  |)0ssible  outcomes 
of  available  plans.  We  view  this  ordering  relation  as  an  ideal,  but  cannot  hope  to  completely  and 
directly  encode  it  in  a  planning  system,  as  the  domain  of  outcomes  is  combinatorially  large  or 
infinite,  and  the  relevant  preference  criteria  vary  across  problem  instances.  Therefore,  in  designing 
f)reference  languages,  we  seek  constructs  for  (h'scribing  general  pattcrris  of  preference  that  hold 
over  classes  of  outcomes  and  situations.  Toward  this  end,  we  have  developed  a  qualitative  logic 
of  preference  ceteris  paribrts  or  preference  “other  tilings  equal”  [12,  13,  31]  in  collaboration  with 
Michael  Wellman.  This  logic  affords  flexible  siiecification  of  objectives,  underpinned  by  a  decision- 
theoretic  semantics. 

The  most  common  representation  used  or  assumed  for  preference  information  is  that  of  numer¬ 
ical  utility  functions.  These  have  the  advantage  of  offering  complete  comparisions  of  the  relative 
desirability  of  all  alternatives  and  of  applying  numerical  optimization  procedures  in  decision  mak¬ 
ing.  But  they  also  suffer  from  severe  prolikmis  of  convenience  and  generality,  especially  when 
attempting  to  integrate  them  into  the  automatic  reasoning  and  planning  system  develope<l  in  the 
artificial  intelligence  literature.  In  the  first  place,  numeric  utility  functions  are  too  specific:  the 
foundations  of  decision  theory  and  economics  start  with  qualitative  preference  orders,  and  many 
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different  utility  functions  can  represent  the  same  preference  order  [26].  Tims  a  utility  function 
may  convey  more  information  than  is  really  there.  Tn  the  second  place,  while  utility  functions 
make  some  optimization  procedures  convenient,  they  tend  to  make  specification  and  elucidation  of 
preferences  difficult.  Most  people  exhibit  a  well-known  aversion  to  expressing  their  judgments  in 
numerical  terms,  yet  are  often  willing  to  provide  (jualitative  expre.ssions  of  preference  with  confi¬ 
dence.  Working  directly  with  utility  functions  thus  makes  people  hesitant  to  supply  the  necessary 
information,  and  also  provides  no  way  to  make  use  of  the  ciualitative  comparisions  that  informants 
might  provide  immediately.  In  the  third  place,  utility  functions  provide  no  connection  with  the 
notion  of  goal  upon  which  most  reasoning  and  planning  systems  in  use  in  artificial  intelligence  are 
based.  Most  of  these  systems  solve  problems  and  construct  plans  in  response  to  stipulations  of 
one  or  more  propositions  representing  the  goals  to  l^e  achieved.  Decision  theory  has  no  notion  of 
“things  to  be  achieved”,  only  rankings  of  the  relative  desirability  of  outcomes,  while  goal-based 
systems  frequently  have  only  the  notion  of  “things  to  l)e  achieved”  and  no  way  of  comparing  the 
relative  desirability  of  potential  solutions  or  plans. 

In  response  to  these  problems  with  utility  functions,  we  worked  toward  finding  ways  of  repre¬ 
senting  information  about  preferences  that  permits  expression  of  both  standard  decision-theoretic 
information  as  well  as  standard  goal-based  specifications,  so  as  to  l)e  able  to  exploit  the  strengths 
of  both  decision  theory  and  artificial  intelligence.  More  generally,  we  aimed  to  find  preference  rep¬ 
resentations  capable  of  encoding  and  using  what(!ver  preference  information  is  available,  without 
having  to  wait  until  enough  is  specified  to  determine  a  utility  function. 

Our  qualitative  logic  of  preference  ceUris  paribus  provides  a  uniform  language  in  which  one 
can  express  both  ordinary  decision-theoretic  preferences  as  well  as  the  standard  notion  of  goal, 
which  we  interpret  to  mean  conditions  preferred  to  their  opposites  other  things  equal.  It  is  easy  to 
show  that  one  cannot  reasonably  interpret  goals  as  conditions  [)referrcd  to  their  opposites  without 
qualification,  as  that  interpretation  trivializes  planning  with  multiple  independent  goals.  In  partic¬ 
ular,  that  interpretation  forces  all  states  that  satisfy  some  goals  but  not  others  to  be  indifferent;  so 
that  one  cannot  add  any  information  to  the  goals  to  state  that,  for  example,  outcomes  satisfying 
5  goals  are  preferable  to  outcomes  satisfying  only  4.  To  avoid  such  trivialization,  we  relativize  tlie 
comparisons  to  outcomes  that  keep  everything  the  same  except  the  conditions  being  compared.  We 
write  p  ^  q  to  mean  that  p  is  weakly  preferred  to  q  ctltris  paribus^  and  p  t>  q  to  mean  that  p  is 
strictly  preferred  to  q  ceteris  paribus^  that  is,  that  p  ^  q  but  not  q  >  p. 

With  the  notion  of  preference  relativized  in  this  way,  we  can  define  goals  simply  as  propositions 
preferred  to  their  complements  ceteris  paribus.  We  write  ^(p),  therefore,  to  mean  that  p  is  a  weak 
goal,  that  is,  that  p  >  p,  and  write  >(7^)  to  mean  that  p  is  a  strict  goal,  that  is,  that  p  >  p. 

This  formal  semantics  for  goals  permits  us  to  investigate  principles  for  reasoning  with  goals. 
For  example,  some  forms  of  reasoning  decompose  goals  into  sets  of  logically  related  propositions 
(for  example,  sets  of  propositions  yi(4ding  the  original  one  by  conjuiiction  or  disjunction,  iis  in 
subgoaling)  and  treat  these  new  propositions  as  new  goals.  We  may  ask  whether  such  operations 
are  sound  with  respect  to  our  semantics.  In  fact,  the  .semantics  confirms  that  these  operations 
are  not  always  valid.  Decomposing  goals  into  conjunctions  and  disjunctions  of  putative  goals  lu^ed 
not  always  produce  bona  fide  goals  l)ecause  the  decomposition  propositions  may  have  undesiral)le 
properties  (“side-effects”)  in  addition  to  their  relation  to  the  compound  goal.  In  general,  complex 
goals  tell  us  little  about  the  desirability  of  their  constituent  |)arts.  We  do  not  mean  to  suggest  that 
reasoners  stop  using  useful  manipulations  like  conjunctive  and  di.sjunctive  decompositions  of  goals 
just  because  the.se  oi)erations  can  be  unsound.  W(r  only  m(‘an  to  point  out  that  if  a  reasoiier  uses 
uasound  operations,  then  either  it  risks  exhibiting  judgements  through  its  actions  that  conffict  witli 
its  represented  preferences,  or  its  reasoning  introduces  new  assumptions  that  change  the  underlying 
preference  order.  These  [)ossibilities  de.serve  expli(tit  rec'ognition,  and  explicit  treacment  in^some 
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cases. 

More  importantly,  tlie  semantics  entails  various  imi)ortant  principles  for  reasoning  about  goals 
and  preferences.  We  i<lentify  some  important  cases  in  which  preference  ceteris  paribtts  satisfies  a 
dominance  principle,  in  that  if  p  and  q  concern  aspects  of  outcomes  ‘^orthogonal”  to  r  (a  conce[)t 
made  precise  by  the  semantics),  then  p  ^  q  whenever  pr  ^  qr  and  pr  ^  qf.  We  also  relativize 
the  notion  of  logical  independence  of  propositions  to  the  notion  of  independence  ceteris  paribns, 
and  show  that  for  propositions  that  are  orthogonal  and  independent  ceteris  paribus^  conjunctiotis 
and  disjunctions  of  goals  are  themselves  goals.  For  such  propositions,  we  also  derive  a  variety  of 
transitivity  results;  for  example,  propositions  preferred  to  goals  are  also  goals.  It  appears  that  many 
important  decisions  can  be  made  simply  on  the  basis  of  dominance  argTiments  expressed  completely 
qualitatively  in  this  form,  so  this  approach  should  permit  important  decision-making  and  planning 
to  proceed  even  without  numeric  utilities.  Wellman  [29]  has  developed  the  probabilistic  version  of 
this  idea  into  a  dominance-guided  planning  procedure  that  i)lans  ‘hq)  to  tradeoffs”  in  his  terminol¬ 
ogy,  meaning  it  constructs  plans  that  are  optimal  as  far  as  the  qualitative  probabilistic  information 
is  concerned,  and  we  expect  an  even  more  robust  planning  procedure  could  be  constructed  in  a 
similar  fashion  using  only  qualitative  preference  information. 

We  are  continuing  to  develop  the  theoretical  structure  and  inferential  capabilities  of  this  logic 
and  some  close  variants,  but  the  basic  language  already  provides  a  useful  tool  for  encoding  (pialita- 
tive  preferential  information.  Of  course,  a  rich  language  for  encofling  preference  information  would 
include  quantitative  representations  as  well,  and  we  are  working  toward  a  preference  language 
that  spans  the  spectrum  from  completely  (|ualitative  representations  like  our  language  of  compar¬ 
ative  preference  to  ordinary  numeric  utility  functions,  including  intermediate  representations  of 
multiattribute  utility  functions  such  as  subutility  composition  trees  [32],  the  standard  forms  of 
multiattribute  utility  functions  [17],  and  their  application  to  expressing  different  types  of  planning 
goals  [15,  16]. 

7  Conclusion 

Reason  maintenance  offers  imi)ortant  abilities  for  use  in  planning  and  rei)lanning,  but  to  i)rove  useful 
for  large-scale  activities,  the  techniciues  mu.st  be  capable  of  incremental  application  that  does  not 
incur  the  costs  of  global  reconsideration.  We  extended  traditional  reason  maintenance  technkiues 
to  make  use  of  instructions,  expectations,  preferences,  and  market  mechanisms  in  deciding  how  to 
establish  and  revise  belic'fs  and  plan  elements.  In  our  concei)tlon,  the  rational  distributed  reason 
maintenance  service  maintains  only  as  much  coherence  and  grounded  support  as  is  called  for  by  the 
planner’s  purposes.  In  essence,  the  finidamental  operations  of  finding  supporting  arguments  and 
pursuing  consequences  become  flexible  rather  than  routine,  with  different  sorts  of  reasons  indicating 
diffenmt  .sorts  of  prextessing  during  rewisions  in  addition  to  th(*ir  more  overt  indications  of  lik(»lihood 
and  preference  information. 
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